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has  become  a  research  topic  of  increasing  importance  and  of  practical  significance. 

In  this  tutorial,  we  illustrate  properties  and  representation  models  of  trust,  elucidate  trust  measurements  with 
representative  algorithms,  and  demonstrate  real-world  applications  where  trust  is  explicitly  used.  As  a  new  dimension 
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Media 


■  Social  media  greatly  enables 
people  to  participate  in  online 
activities 

-  Networking,  tagging  and  commenting 


■  It  shatters  the  barrier  for  online 
users  to  create  and  share 
information  in  any  place  at  any 
time 


What  Is  Your  #1  Social 
Media  Online  Activity? 


No.l  activity  Is  'read  posts  or 
view  pictures  of  friends" 


1 17%  update 
profile' 


4.4%  "post  pictures 
or  videos' 


on  posts  or 
pictures  of 


S.5% 'participate  In 
quizzes  or  polls' 


empathica 


J 


http://www.marketingprofs.com/charts/2010/4101/social-media-brand-followers-hunting-for-deals 
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Information  Overload 


■  User  generated  content  increases 

at  an  unprecedented  rate 
-  Given  the  big-data  problem,  how  can  we 
find  relevant  content? 


■  Anyone  can  publish  content  in 
social  media 

-  With  so  many  grass-roots  authors,  from 
whom  I  should  collect  information  useful  to 
me 


Twitter:Tweets  Per  Day 


Jan  07  Jan  08  Oct  09  Sep  10  Jun  1 1  Oct  II  Jun  1 2 

Copyright  ©  2012  Dm  Femleib  davc@vcdavc.com  btogj.forbet.com/davefeinleib 


Facebook  User  Growth 


1000 


http://www.forbes.com/sites/davefeinleib/2012/07/09/the-3-is-of-big-data/ 
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Information  Credibility 


■  The  quality  of  user  generated  content  varies  widely 

-  From  excellent  content  to  abuse  and  spam 

-  How  to  find  reliable  information  fast 

■  Anyone  may  access  my  content 

-With  whom  should  I  share  information? 


%6  %4 


Tweets 


■  Pointless  babble 


■  conversational 


■  Pass-along  value 


■  Self-promotion 


■  spam 


https://infomagnet.wordpress.com/2012/05/04/a-comparison-among-the-top-3-social-networks/ 


Trust  in  Social  Media 


■  Trust  provides  information  to  find  answers  like 

-  From  whom  we  should  collect  information 

-  With  whom  we  should  share  information 


■  It  offers  a  mental  shortcut  for  direct  information  seeking 


-  Without  being  overwhelmed  by 
excessive  information,  thus  mitigating 
information  overload 

-  With  credible  information  due  to 
the  trust  placed  on  the  information 
provider,  or  increasing  information 
credibility 


F  1 

Trustor 

k, _ A 


w 


Collect  Info 


A _ 


Share  Info 
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Trust  -  A  Hard  to  Define  Concept  [McKnight  et  ai.  2001] 


■  Trust  is  a  very  broad  and  complex  concept 

-  Multidisciplinary 

-  More  than  60  definitions  in  the  literature 


■  Each  discipline  has  its  own  perspective  of  trust 


-  Personality  in  Psychology 

-  Social  structures  in  Sociology 

-  Rational  choice  in  Economics 


■  Let's  first  look  at  what  happens  in  social  media  before  we 
settle  on  a  definition 
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Online  Trust  Systems  [Massa,2oo7] 


■  E-marketplaces 

-  Selling  and  buying  items 


Opinion  and  activity  sharing  sites 

Sharing  opinions 

Business/job  networking  sites  /\  chl 

Sharing  job  skills 

Social/entertainment  sites 
Networking  and  sharing  UGC 


X  _  —  I 

■r  — 


Epinions  Com 


8 


■  News  sites  (e.g.,  Slashdot) 

-  Posting  news  and  stories 

Slashdot 

/. 

ffiL-  Data  Mining  and^i TrUSt *><*>'  Computing 
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■  There  are  two  types  of  users  -  sellers  and  buyers 

■  Buyers  assess  the  trustworthiness  of  sellers  according  to  the 
reliability  of  the  services  or  products  they  provide 


zyderstores  (69*) 

97.1  %  positive  feedback 

I — -  Based  in  United  States,  zyde 


+  Follow 


Feedback  ratings 

★  ★★★*  33 

★  ★★★*  30 

★  ★★★■*  32 

★  ★★★★  37 


0 

Item  as  described 
Communication 
Shipping  time 
Shipping  charges 


Q  34  O  3  ©  1 

Positive  Neutral  Negative 


Feedback  from  the  last  12  months 


htt  p :/  /www.  e  bay.  co  m/us  r/zyd  ersto  res 
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Epinions 


■  There  are  two  roles  of  users  in  Epinions  -  reviewers  (who 
write  reviews)  and  raters  (  who  rate  the  helpfulness  of 
reviews) 

■  Raters  add  a  reviewer  into  their  trust  circle  if  they  think  her 
reviews  are  helpful 


Web  of  Trust 


jankp  trusts: 

1.  TheSmartTraveler 

2.  mizsallyforth 

3.  majenta 

4.  merlejevy 

5.  thewisefool 

►  View  all  598  members 
whom  jankp  trusts 

jankp  is  trusted  by: 

1.  Kirbylee 

2.  HawgWyld 

3.  banyergang 

4.  rajaahmed 

5.  MamaMiaEtc 

►  View  all  530  members  who 

trust  jankp 


jankp's  Profile 


About  jankp 

czasmmz] 


in  Music,  Movies,  Books 


IPQ^U.  AR  author  |  _Tnp  ioo 

Member:  Jan  Peregrine 


http://www.epinions.com/user-jankp 


jankp 

Jan  Peregrine  ^ 
Lincoln,  NE 
Dec  17, 1999 
Getting  To  Know  Jan.™ 

Climate  Change  W-Q 
Graphic  Novel  Bust-Out 
Artistic  Inspiration  W-0 


Published  From_Out_of_the_Desert:  on  amazon.com  now! 
more 


Epinions.com  ID: 
Google  Profile: 
Location: 

Member  Since: 
Homepage: 

Favorite  Websites: 
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■  Advogato  is  a  community  site  of  free  software  developers 

■  Developers  share  their  developing  skills  and  raters  will 
rate  them  with  three  trust  levels  -  Master,  Journeyer  and 


Apprentice 


http://www.advogato.org/person/badvogato/ 


Others  have  certified  badvogato  as  follows: 

•  draaotown  certified  badvogato  as  Master 

•  beto  certified  badvogato  as  Master 

•  e steve  certified  badvogato  as  Journeyer 

•  aerrvl 3  certified  badvogato  as  Master 

•  dmitri  certified  badvogato  as  Master 

•  michaelemma  certified  badvogato  as  Journeyer 

•  sashako  certified  badvogato  as  Journeyer 

•  Tofu  certified  badvogato  as  Apprentice 

•  sulaiman  certified  badvogato  as  Journeyer 

•  ekasho  certified  badvogato  as  Journeyer 

•  hereticmessiah  certified  badvogato  as  Master 

•  pencechp  certified  badvogato  as  Journeyer 

•  wardv  certified  badvogato  as  Journeyer 

•  nixnut  certified  badvogato  as  Master 

•  damn  certified  badvogato  as  Master 

•  nikole  certified  badvogato  as  Master 

•  mirwin  certified  badvogato  as  Master 

•  molazer  certified  badvogato  as  Journeyer 
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A  Definition  of  Trust  [Massa,  2007] 


The  explicit  opinion  expressed  by  a  user  about  another 
user  regarding  the  perceived  quality  of  a  certain 

characteristic  of  this  user 
-  Inter-personal  trust 


Trustor 


Trustee 


-  Network  representation 


1.2 


Challenges  in  Studying  Trust  in  Social  Computing 


■  Challenge  1:  Social  media  data  is  based  on  passive 
observations 

-  A  large  number  of  online  users 

-  Lack  of  some  information  other  disciplines  use  to  study  trust 
-Traditional  methods  require  interaction  with  users  (or  subjects) 

-  Study  trust  with  only  passive  observation 

■  Challenge  2:  Social  media  data  is  social 

-  A  new  type  of  social  data 

-  Big,  noisy,  and  incomplete 

-To  handle  big  social  media  data  for  trust  research,  we  need  effective 
and  efficient  computational  tools 


/mi 
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Computational  Tasks  for  Trust 


■  The  challenges  from  social  media  also  offer 
opportunities  to  study  trust  from  a  computational 
perspective 

■  Four  major  computational  tasks 

-  Representing  trust 

-  Measuring  trust 
-Applying  trust 

-  Incorporating  distrust 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  16 


Representing  Trust 


■  It  aims  to  represent  trust  relations  among  users 

■  Given:  a  trust  network 

■  Output:  a  mathematical  representation  that  is  computable 


/mi 
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Measuring  Trust 


■  It  aims  to  measure  how  much  a  user  can  be  trusted  by 
another  user  in  the  same  trust  network 

■  Given:  a  trust  network  and  a  user  pair  <u,  v,  ?> 

■  Output:  the  missing  trust  value  is  found  <u,  v,  t> 


Arizona  State! 
University  < 
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Applying  Trust 

■  It  aims  to  incorporate  trust  to  facilitate  online  applications 
such  as  online  recommendation 

■  Trust-aware  recommendation  aims  to  incorporate  trust 

information  in  traditional  recommender  systems 

-  User-user  trust  information 

-  User-item  rating  information 


2  1  7  4  2  ? 

3  1  5  7  2  ? 

?  7  4  ?  1  4 


3  7  7  5  7  4 

7  2  5  4  1  7 


?????? 


0.5 


User-item  rating  information 


User-user  trust  information 


Incorporating  Distrust 


It  studies  how  to  incorporate  distrust  in  improving  trust 
computation 


-  Computational  understanding  of  distrust 

-  Representing  distrust  with  trust 

-  Measuring  distrust  with  trust 

-  Applying  distrust  to  improve  trust  computation 


User-user  trust  information 


User-user  distrust  information 


Arizona  State! 
UNTVERsnr  ' 
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A  Real-World  Dataset  for  Studying  Computational  Trust 


Epinions 

-Trust/distrust  relations 

-  Item  rating: 

-  Helpfulness  ratings 

-  Review  content 


Review  Title 

Product/Topic 

Product  Rating 

Review  Rating 

Mickey  and  Willie:  the 
Parallel  Lives  of  Baseball's 
Golden  Age 

Mickey  and  Willie  :  Mantle 
and  Mays,  the  Parallel 
Lives  of  Baseball  s 

Golden  Age  by  Allen  Barra 
(2013,  Hardcover) 
in  Books 

Very  Helpful 

Web  of  Trust 


sleeper54  trusts: 

219  hidden  members 

sleeper54  is  trusted  by: 

1.  brroberts2 

2.  thrown 

3.  csmithesq 

4.  beeefcake 

5.  aohcapablanca 

►  View  all  568  members  who 
trust  sleeps r54 


#  of  Users 

30,455 

of  Trust 

363,773 

#  of  Distrust 

46,196 

#  of  Users  Receiving  Distrust 

9,513 

#  of  Users  Creating  Distrust 

5,324 

of  Items 

89,270 

#  of  Ratings 

562,355 

Avg  of  Rating  Score 

3.9053 

/mi 
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Trust  and  Distrust  Distributions 


Distributions  follow  a  power-law-like  distribution 
A  typical  distribution  for  networks  in  social  media 
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Importance  of  Representing  Trust 


■  Any  algorithms  in  measuring  trust,  applying  trust,  and 
incorporating  distrust  are  based  on  certain  trust 
representations 

■  Representing  trust  is  the  first  step  to  make  trust  computable 

■  Properties  of  trust  serve  as  the  foundation  of  trust 
representations 

-Single  vs  multi-dimensional  trust  representations 

■  Some  important  properties  include 
-Transitivity  and  composability 
-Asymmetry,  and  correlation  with  similarity 


MU 
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Transitivity  [Goibeck,  2005] 


■  Transitivity  allows  trust  to  propagate  along  paths  to  reach 
other  users 

■  If  u  trusts  v  and  v  trusts  w,  it  can  be  inferred  that  u  might 
also  trust  w  to  some  extent 


■  Trust  is  not  perfectly  transitive  in  the  mathematical  sense 

and  is  conditionally  transitive 

-Trust  networks  in  social  media  are  large 

-  Users  in  trust  networks  are  world-widely  distributed 

-There  are  many  pairs  who  do  not  know  each  other  in  trust  networks 


mi 
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Transitivity  Illustration 


■  If  u+v  and  v+w,  there  are  88.34%  of  u  and  w  without  trust 
relations 

■  If  we  can  observe  relations  between  u  and  w,  97.75%  of 

them  are  trust  relations 

-  PI  =  {#  (u?w) }  /  {#(u+w)  +  #(u-w)  +  #(u?w)} 

-  P2  =  {#(u+w) }  /  {#(u+w)  +  #(u-w)} 


Types 

Number 

PI 

P2 

(u+v, v+w),  ulw 

25.584,525 

88.34% 

N.A 

(u+v, v+w),  u+w 

3.320,991 

11.46% 

97.75% 

(u+v, v+w),  u-w 

76,613 

0.2% 

2.25% 

u+v,  u-v,  and  u?v  represent  u  and  v  with  trust,  distrust,  and  missing  relations,  respectively 
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Composability  [Goibeck,  2005] 


■  Transitivity  describes  how  trust  can  be  passed  through  one 
path 

■  Composability  describes  that  a  user  should  combine  the 
different  trust  values  received  from  different  paths 

Path  1 


For  (u,w),  there  are  two  paths 
(u+v+wand  u+x+y+w). 

u  should  compose  trust  values 
from  both  u+v+w  and  u+x+y+w 
for  w 


Path  2 
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Asymmetry  [Goibeck,  2005] 


■  For  two  people  involved  in  a  trust  relation,  trust  is  not 
necessarily  identical  in  both  directions 

■  The  trust  value  from  user  u  to  user  v  is  not  necessarily  equal 

to  that  from  user  v  to  user  u 
-  One  way  trust  for  binary  trust 


-  Different  trust  values  for  continuous  trust 


pm 
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Asymmetry  Illustration 


■  There  are  37.61%  of  pairs  of  users  with  mutual  trust 
relations 


v+u{%) 

v-u(%) 

v?u(%) 

u-\-v 

136.806(37.61) 

967(0.27) 

226,000(62.13) 

■  Trustees  who  have  fewer  trustors  are  more  likely  to  trust 
their  trustors  [Tang  et  al.  2012] 
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Correlation  with  Similarity  [Ziegler  and  Goibeck,  2007] 


■  There  is  a  strong  correlation  between  trust  and  similarity 

-  Users  with  trust  relations  are  likely  to  be  similar 

■  Social  correlation  theories  can  explain  this  correlation 

-  Homophily,  influence  and  confounding 


Individual 

Characteristics 


Trust 

Relations 


>L 

Trust 

Relations 

-j 

V 

- \ 

Individual 

Characteristics 

^ _ > 


A:  Homophily 


B:  Influence 


C:  Confounding 


mi 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  30 


Verifying  the  Correlation 


■  For  each  trust  relation,  we  calculate  two  similarities 

-  Similarityl:  trustor  and  trustee 

-  Similarity2:  trustor  and  a  randomly  chosen  user 

■  We  define  two  vectors  s  =  {  similarityl}  and  t  =  {similarity2} 

■  We  conduct  a  two-sample  t-test  on  s  and  t 

Ho:  s <=  t;  Hi:s>t 

The  null  hypothesis  is  rejected  at  significance  level  0.01  with  p-value  of  3.76e-21 
in  Epinions 


Trustee 


Random 
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Homophily  [Tang  et  al.,  2013] 


■  Similar  users  are  more  likely  to  establish  trust  relations 

■  Verification  of  homophily 

-  Sort  trust  relations  based  on  the  creation  time  in  chronological  order 

-  Split  data  into  m  pieces  with  equal  size  and  time  points  are  {ti,t2,...,tm} 

-  Divide  pairs  of  users  without  trust  relations  until  time  ti  into  two  equal 
groups  -  high-similarity  group  H  and  low-similarity  group  L 

-  Compute  the  numbers  of  pairs  creating  trust  relations  hi  and  li  at  time 
ti+i  for  H  and  L,  respectively 

-  h  =  {hi}  and  I  ={h} 

-  A  two  sample  t-test  is  conducted  on  h  and  I 

Ho:  h<=l;  Hi:  h  >  I 


The  null  hypothesis  is  rejected  at  significance  level  0.01  with  p-value  of  7.51e-64 
in  Epinions 
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Influence  [Yeung  and  Iwata,  2011] 


■  Users  tend  to  follow  the  behaviors  of  trusted  users  and 
users  with  trust  relations  are  likely  to  exhibit  similar 
behaviors 

■  Changes  of  users'  cosine  similarity  100  days  before  and 
after  trust  relations  were  established 


-  Similarity  increases  before  they  trust  each  other,  and  continues  to 
increase  after  that 
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Trust  Representation  Classifications 


■Trust  representations  can  be  classified  from 
different  perspectives 

■  Probabilistic  vs.  gradual  trust  representations 
-  From  an  interpretation  perspective 
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Probabilistic  Representations  [victor  et  ai.,  2011] 


■  Probabilistic  representations  use  probabilities  to  indicate 

how  much  trust  is  placed  by  a  user  to  another 

-  Stronger  trust  corresponds  to  a  higher  probability 

-  (u,v,p)  represents  the  probability  p  of  u  trusting  v 

-  p  =  1  represents  full  trust  while  p  =  0  indicates  no  trust 


■  Weights  in  the  trust  network 

represent  the  probability 

-  (u,v,0)  is  represented  no  link  between 
u  and  v  in  the  trust  network 

-  Probabilities  usually  follow  a  certain 
distribution  such  as  beta  distribution 
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Illustrations  of  Probabilistic  Representations 


Probabilistic  Matrix 
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Gradual  Representations  [victor  et  ai.,  2011] 


■  Trust  is  often  interpreted  as  a  gradual  phenomenon  in 
real  life 

-Trusting  someone  "very  much",  "  more  or  less",  "little"... 
-Gradual  representations  become  increasing  popular 

■  Gradual  representations  use  continuous  values  to 
represent  trust 

-  The  values  can  be  any  values  so  they  cannot  be  explained  as 
probabilities 

-The  values  directly  indicate  trust  strengths 

-  (u,v,t)  denotes  that  the  trust  value  from  u  to  v  is  t 

-  Weights  in  the  trust  network  denote  trust  values 

-t  =  0  indicates  no  trust  and  there  is  no  link  in  the  trust  network 
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Illustrations  of  Gradual  Models 


Trust  Value  Matrix 
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Trust  Representation  Classifications 


■  Trust  representations  can  be  classified  from 
different  perspectives 

■  Probabilistic  vs.  gradual  trust  representations 

-  From  an  interpretation  perspective 

■  Single  vs.  multi-dimensional  trust  representations 

-  From  a  dimension  perspective 
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Multi-dimensional  trust  representations 


■  Trust  is  a  complex  concept  with  multiple  dimensions 
-  Multi-faceted  trust 
-Trust  evolution 

■We  need  to  extend  single  trust  representations  to 
multi-dimensional  trust  reoresentations 
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Multi-Faceted  Trust  [Tang  et  ai.,  2012] 


■  Trust  is  context  dependent 

-Trusting  someone  on  one  topic  does  not  necessarily  mean  he  will 
be  trusted  on  others 


■  An  illustrative  example  using  the  Epinions  dataset 
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Multi-faceted  Trust  Representation 


A  matrix  representation  can  be  extended  to  a  tensor 

representation  for  multi-faceted  trust 

-  <u,  v,  f,  p> 

-  For  probabilistic  models,  u  trusts  v  with  probability  p  in  the  facet  f 

-  For  gradual  models,  the  trust  value  between  u  and  v  in  the  facet  f  is  p 


A 


n  users 


n 

1 

n  users 

n  users 


n  users 
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Findings  from  Multi-faceted  Trust  Representation 


Heterogeneous  transitive  trust 

User  i  trusts  user  j  in  fi  and  user  j  trusts  user  k  in  f2 

22.3%  transitive  trust  relations  are  heterogeneous 


O 


A 


O*— O 


A 


k 
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Heterogeneous  reciprocal  trust 

User  i  trusts  user  k  in  fi  and  user  k  trusts  i  in  f2 

23.5%  of  reciprocal  trust  relations  are  heterogeneous 
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Trust  Evolution  [Tangetal.  2012] 


■  Social  sciences  suggest  that  trust  evolves  as  humans  interact 

■  An  example  from  an  online  rating  system  Epinions 


Racing 

Users  and  the  Trust  Network  Items 

i 


(a)  Rating  System  at  Ti 


(b)  Rating  System  at  T2 
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Trust  Evolution  Representations 


■  3-order  tensor  representations  for  trust  evolution 

-  <u,  v,  T,  p> 

-  For  probabilistic  models,  u  trusts  v  with  probability  p  at  time  T 

-  For  gradual  models,  the  trust  value  between  u  and  v  at  time  T  is  p 

■  4-order  tensor  representations  for  multi-faceted  and 
evolved  trust 

-  <u,  v,  f,  T,  p> 

-  For  probabilistic  models,  u  trusts  v  with  probability  p  in  the  facet  f  at 
time  T 

-  For  gradual  models,  the  trust  value  between  u  and  v  in  the  facet  f  at 
time  T  is  p 
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Findings  of  Trust  Evolution 


■  Trust  strength  in  an  open 
triad  evolves  faster  than  that 
in  a  close  triad 


Open  Triad 


Closed  Triad 


■  Trust  evolves  over  time  with 
the  changes  of  user 
preferences 

■  Trust  evolves  differently  in 
different  facets 


User  ID 
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Trust  Representation  Classifications 


■Trust  representations  can  be  classified  from  different 
perspectives 

■Probabilistic  vs.  gradual  trust  representations 

-  From  a  interpretation  perspective 

■Single  vs.  multi-dimensional  trust  representations 

-  From  a  dimension  perspective 

■Trust  vs.  trust  and  distrust  representations 

-  From  a  network  perspective 
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Measuring  Trust 


Summary 


Incorporating 

Distrust 
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Applying 

Trust 


Definitions 


■  A  trust  metric  measures  how  much  a  certain  user  can  be 

trusted  by  the  other  users  for  the  community 

-  Measuring,  inferring  and  predicting  trust 


■  Propagation  is  assumed  in  most  trust  metrics 

-  We  trust  our  trustees  more  than  a  stranger 

-  A  trustee  of  our  trustee  is  possibly  more  trustworthy  than  a  random 
stranger 
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Classifications  [Zieglerand  Lausen,  2005] 


■  Trust  metrics  can  be  classified  from  different 
perspectives 

■  Global  and  local  trust  metrics 

-  From  a  personalization  perspective 

■  Supervised  vs  unsupervised  trust  metrics 

-  From  a  methodology  perspective 

■  Binary  or  continuous  trust  metrics 

-  From  a  network  perspective 
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Global  and  Local  Metrics 


■  Global  metrics  predict  the  same 

trust  of  a  given  user  for  all  users 

-  Each  user  with  a  global  trust  value 

-  E.g.,  Reputation  systems 


■  Local  metrics  provide  a  personalized  trust  score  that 

depends  on  the  point  of  view  of  the  evaluating  user 

-  Each  pair  of  users  with  a  trust  score 

-  Personalized  trust 

-  Users  may  have  completely  different  opinions  about  the  same  user 
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Page  Rank  [Page  et  al.,  1999] 

■  PageRank  is  a  global  metric 


■  Pagerank  is  from  trustees' 
perspective 

■  The  trustworthiness  of  a  trustee  is 
aggregated  from  her  trustors 

-Trustors'  trustworthiness 

-Trust  values 


User  1  will  give  more  her 
trustworthiness  to  user 
2  compared  to  user  3 


xi  =  cc 


j 
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EigenTrUSt  [Kamvar  et  al.,  2003] 


■  Asking  your  trustees  and  aggregating  trust  for  trustees 


-  Ask  your  trustees:  t  =  Clo 

-  Ask  trustees'  trustees:  t  =  (CT)2o 

-  Keep  asking  until  t  converges:  t  =  (CT)n  o 


cii +  C‘'1  + 


i2 


■  When  n  is  large,  t  converges  to  the  same  vector  for  every  user 


- 1  is  the  eigenvector  of  C 


t*+D=CTtw 
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An  Illustration  Example  of  EigenTrust 


Normalization 
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TidalTrust  [Goibeck,  2006] 


■  TidalTrust  is  guided  by  two  observations 

-  Shorter  propagation  paths  produce  more  accurate  trust  estimates 

-  Paths  with  higher  trust  values  create  better  results 

■  For  a  pair  of  users  /  and  s  who  are  not  directly  connected,  a  trust  value 
is  aggregated  from  the  trust  value  from  i's  direct  neighbors  to  s, 
weighted  by  the  direct  trust  values  from  /  to  her  direct  neighbors 


The  length  of  a  path  is  determined  by  the  number  of  edges  the  source  must  traverse  before  reaching  the  sink 
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An  Illustration  Example  of  TidalTrust 
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MoleTrUSt  [Massa  and  Avesani,  2005] 


■  Cycles  in  a  trust  network  are  removed 

-The  removal  reduces  the  number  of  trust  propagations 

-The  trust  network  is  transformed  into  a  directed  acyclic  graph 


■  Trust  values  are  calculated  based  on  the  directed  acyclic 

graph  by  performing  a  simple  graph  random  walk 

-  The  trust  of  the  users  at  1-hop  away  is  computed 

-  The  trust  of  the  users  at  2-hop  away,  etc. 
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Comparison  between  Global  and  Local  Metrics 


■  Global  metrics 

-  For  n  users,  we  only  need  to  compute  n  values 

-  Efficient  to  compute  and  maintain 

-  Providing  a  global  view  about  a  user's  reputation 


■  Local  metrics 

-  For  n  users,  we  have  n*n  pairs  of  users 

-  Providing  personalized  trust  values 

-  Applying  to  controversial  users 
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Supervised  Metrics 


■  Supervised  metrics  consider  trust 
prediction  as  a  classification  problem 

■  Training  data  preparation 

-Trust  as  the  positive  label 

-  Not  trust  as  the  negative  label 

■  Feature  extraction 

-  Extracting  a  set  of  features  from 
available  sources  to  represent  pairs 
of  users 

■  Different  supervised  metrics  use 
different  feature  sets  and  classifiers 


Other  sources: 
interaction  activities 


Z'  Pairs 
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Sampling  pairs  labeled  0 
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Binary  classifiers: 
SVM 
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Method  by  Liu  et  al.  [Liu  et  ai.,  2008] 


■  It  assumes  there  are  two  reasons  a  user  trusts  another  user 

-The  trustee  has  good  reputation 

-There  have  been  good  personal  interactions  between  the  two  users 

■Each  reason  is  captured  by  a  set  of  features 

-  Features  based  on  user  factors 

-  Features  based  on  interaction  factors 

■  SVM  and  NB  classifiers  are  trained  to  predict  trust 

■  Interaction  factors  have  greater  impact  on  trust  decisions 
than  user  factors 

-  Trust  is  highly  relevant  to  user  interactions 
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Method  by  Nguyen  et  al.  [Nguyen  etai.,  2009] 


■  It  is  based  on  trust  antecedent  framework  in  management  science 

-  Ability,  benevolence  and  integrity  as  key  factors  that  leads  to  trust  on  a  trustee 

-  Trust  propensity  is  a  factor  that  determines  how  easy  a  trustor  trusts  someone 

-  Once  a  trust  is  formed,  the  trustor  is  more  willing  to  take  more  risk 

-  The  outcome  of  risk  taking  will  serve  as  feedback  to  modify  the  perception  about 
trustee's  ability,  benevolence  and  integrity 


■  Each  factor  is  approximated  through  a  set  of  quantitative  features 

-  Features  for  integrity:  the  number  of  trust  statements  the  user  receives 

-  Features  for  ability:  the  number  of  reviews  rated  by  the  rater 
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Unsupervised  Metrics 


■  Unsupervised  methods  are  usually  based  on  the 
connectivity  of  users  in  trust  networks 


-Trust 


-  Low-rank  representations  of 
trust  networks 


Direct  Propagation 


di  d  2 


Low- rank  representation 
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Trust  Propagation  [Guha  et  ai.,  2004] 


Four  types  of  atom  trust  propagations 


Direct  propagation 


Transpose  trust 


Co-citation 


Trust  Coupling 


/mi 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  63 


Propagation  Operations 


Atomic  Propagation 

Operator 

Description 

Direct  propagation 

T 

If  A  trusts  B,  and  B  trusts  C,  then  A 
may  trust  C 

Transpose  trust 

Tt 

A's  trust  of  B  causes  B  to  develop 
some  level  of  trust  towards  A 

Co-citation 

TtT 

If  A  trusts  B  and  C,  D  trusting  B 
implies  D  should  trust  C 

Trust  Coupling 

TTt 

If  A  and  B  trust  C,  trusting  A  should 
imply  trusting  B 
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Trust  Propagation  Aggregation 


■  A  combination  of  four  types  of  propagations 

C  =  aT+bTTT+cTT +dTTT 

a,  b,  c,  and  d  are  the  weights  for  these 
four  types  of  propagation,  respectively 

■  Aggregation  after  K-step  propagation 

f  =  t 

k= 1 

rk  is  the  aggregation  weight  for  the  k-th  propagation 
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An  Illustration  of  Trust  Propagation 
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An  Illustration  Example  of  Trust  Propagation 
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n=r2=0.5 


0 

1.2 

0.6 

0 

0 

0 

0.5 

0 

0 

0 

0 

0.5 

0.1 

0 

0 

0.3 

0.9 

0 

0 

0.7 

0 

0 

0 

0.2 

0 

0 

0 

0.8 

0 

0 

0 

1 

0 

0 

0.5 

0 

f  =  0.5Q+0.5C2  = 


0.28 

0.55 

0.25 

0.11 

0.01 

0.18 

0.46 

0.49 

0.10 

0.10 

0.06 

0.45 

0.13 

0.10 

0.16 

0.15 

0.49 

0.05 

0.11 

0.49 

0.04 

0.16 

0.13 

0.22 

0.01 

0.06 

0.14 

0.63 

0.21 

0.06 

0.18 

0.54 

0.05 

0.11 

0.23 

0.19 

/mi 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  67 


Low-rank  Matrix  Factorization  [Tang-etai.,2013] 


■  Trust  is  multi-faceted  and  is  correlated  to  user  preferences 

-Assume  Ui  is  the  k-dimensional  preference  vector  of  the  user  i 

-  V  is  a  K  x  K  correlation  matrix 

-A  trust  relation  between  user  i  and  user  j  can  be  modeled  as  the 
interactions  between  their  preferences  by  V  as 

T  =  U  VU . 

y  *  j 

■  Low-rank  matrix  factorization  model  can  capture  the  major 

properties  of  trust, 

-  Multi-faceted 

-Correlation  with  user  preferences 
-Transitivity and  asymmetry 
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An  Illustration  of  Low-rank  Matrix  Factorization 
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Comparison  of  Supervised  and  Unsupervised  Metrics 


■  Supervised  metrics 

-  The  number  of  pairs  without  trust  is  much  larger  than  those  with 
-The  classification  problem  is  highly  imbalanced 

-  They  need  extra  sources  to  extract  features 
-They  usually  outperform  unsupervised  metrics 

-  They  can  be  applied  to  users  with  few  trust  relations 

■  Unsupervised  metrics 

-  They  only  depend  on  the  structure  of  trust  networks 

-  They  may  fail  for  users  with  few  trust  relations 

-  They  can  be  applied  to  both  binary  and  weighted  trust  networks 
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Binary  and  Continuous  Metrics 


■  Binary  metrics  are  used  to  predict  whether  users  are  trusted 

or  not  trusted 

-  {l:trust,  0:  not  trust} 

-  For  supervised  metrics,  trust  and  not  trust  are  positive  and  negative 
labels  to  predict  by  learnt  classifiers 

-  For  unsupervised  metrics,  trust  values  in  a  certain  region  are  treated 
as  trust,  otherwise  as  not  trust 

■  Continuous  metrics  are  to  infer  trust  values  for  pairs  of 
users 

-  Nonnegative  real  number 

-  Continuous  metrics  are  usually  unsupervised  methods 


/mi 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  71 


Evaluations  of  Trust  Metrics 


■  There  are  many  evaluation  metrics  proposed  to  assess  the 
performance  of  trust  metrics 

■  Ranking-based  evaluation 

■  RMSE  evaluation 

■  Leave-one-out  cross-validation  evaluation 

■  F-measure  evaluation 
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Ranking-based  Evaluation 


■  x%  as  old  trust  relations 

■  1  -  x%  as  new  trust  relations 

■  Ranking  pairs  of  users  in  N  and  B 

■  Choosing  top- 1 N  |  ranked  pairs  as  C 
as  predicted  trust  relations 

■  Calculating  the  prediction  quality  as 

N 


PA  = 


I  iVoCI 

I  N  I 


1 

2 

3 

4 
1 


N 


B 


c 


X%  |  1-X% 

Pairs  with  trust 


Pairs  without  trust 


n2  pairs  of  users 


2 

5 

5 

6 
5 


PA  = 


-  =  0.2 

5 


The  value  of  PA  is  usually  small  and  to  demonstrate  the  significance  of  performance,  randomly 
guessing  predictor  is  usually  used  as  a  baseline  method 
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RMSE  Evaluation 


x%  as  old  trust  relations  0 
1  -  x%  as  new  trust  relations  N 
Computing  trust  values  for  pairs  of  users  in  N 
Calculating  RMSE  as 


T 

ij 

T 

V 

0.2 

0.2 

0.4 

0.5 

0.5 

0.5 

0.7 

0.6 

0.4 

0.5 

RMSE  = 


<ut  ,Uj>^N 


I  TV  I 


RMSE  = 


(0.2  -  0.2)2  +  (0.5  -  0.4)2  +  (0.5  -  0.5)2  +  (0.6  -  0.7)2  +  (0.5  -  0.4): 


=  0.0775 
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Leave-one-out  Cross-validation 


■  Step  1:  Given  a  full  network,  randomly  hide  one  of  the 
trust  relations 

■  Step  2:  Predict  the  existence  of  the  hidden  trust  relation 
which  has  been  suppressed 

■  Step3:  Repeat  Step  1  and  Step  2  n  times 

■  Assume  that  the  predictor  infers  these  hidden  relations 
correctly  m  of  n  times,  then  the  accuracy  is  m/n 
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F-measure  Evaluation 


■  Trust  and  not  trust  are  treated  as  the  positive  and  negative 
labels,  respectively 

■  Precision,  recall  and  F-measure  are  defined  as 


.  .  tp 

precision  = - 

tp+ fp 


recall  = 


tp 


tp  +  fn 

FI _ ^  precision. recall 
precision+  recall 


y 

P 

(Predicted) 

rV 

(Predicted) 

p 

(Actual) 

True  Positive 

False  Negative 

n 

(Actual) 

False  Positive 

True  Negative 
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Evaluation  Metrics  for  Measuring  Trust 


■  Ranking-based  evaluation 
-Binary  trust  metrics 
-Unsupervised  metrics 

■RMSE  evaluation 

-Continuous  metrics 

■Leave-one-out  cross-validation  evaluation 

-Supervised  metrics 

■F-measure  evaluation 

-Supervised  metrics 
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Applying  Trust 


Summary 


Incorporating 

Distrust 
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Trust 


Trust-aware  Recommender  Systems 


■  In  this  physical  world,  people  seek  recommendations  from 
their  trusted  friends 

■  A  user's  preference  is  more  likely  to  be  similar  to  those  of 
her  trust  network  than  to  those  of  randomly  chosen  users 
-Trust  information  may  provide  preference  context  of  a  user 
-Homophily  and  influence 

■  Trust-aware  recommender  systems  augment  traditional 
recommender  systems  with  trust  information 

-  User-item  rating  matrix  R 

-  User-user  trust  matrix  T 
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Traditional  Recommender  Systems 


■  Content-based  recommender  systems 

-  Recommend  items  similar  to  the  ones  that  the  user  has  preferred  in 
the  past 


■  Collaborative  filtering  (CF)  -based  recommender 
systems 

-  Using  the  user's  past  behavior  to  uncover  user  preferences  and 
recommend  items  that  match  their  preferences 

-  Only  depending  on  users'  past  behaviors 

-  Memory-based  CF  and  Model-based  CF 
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Memory-based  Collaborative  Filtering 


■  It  uses  either  the  whole  user-item  matrix  or  a  sample  to 
generate  a  prediction 

-  Needing  memory  to  store  the  user-item  rating  matrix  R 

■  User-oriented  collaborative  filtering 

-  Calculating  user-user  similarity 

-  Aggregating  ratings  from  similar  users 

■  Item-oriented  collaborative  filtering 

-  Computing  item-item  similarity 

-  Aggregating  ratings  from  similar  items 
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An  Illustration  of  User-oriented  Collaborative  Filtering 


D 

B 

C 

D 

E 

D 

5 

3 

4 

? 

? 

2 

? 

3 

4 

4 

? 

3 

1 

? 

2 

2 

5 

2  and  3  are  similar  users  to  1 
A,  B,  C,  D,  and  E  are  items 
R(1,D)  =? 


■  Cosine  similarity  calculation 


S  (1,2)  = 


S  (1,3)  = 


3*3+4*4 

a/3  *3  +  4*4  a/3  *3  +  4*4 
4*l+4*2 

a/1  *1  +  2*2  a/4*4  +  4*4 


=  1 

=  0.9487 


■  Aggregating  ratings 


R(ID) 


4*1  +  2*0.9487 
1  +  0.9487 


3.03 
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Model-based  Collaborative  Filtering 


■  It  assumes  a  model  to  generate  the  ratings  and  learns  the 
parameters  of  the  model 

-Storing  only  parameters  instead  of  the  rating  matrix 

-  Using  the  assumed  model  with  parameters  to  do  prediction 

■  Matrix  factorization  methods  are  very  competitive  and  are 
widely  adopted  to  build  recommender  systems 

-  Ui  is  the  k-dimensional  user  preference  vector  of  user  i 

-  Vj  is  the  k-dimensional  item  characteristic  vector  for  item  j 

-  A  rating  from  user  i  to  item  j  is  modeled  as 
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An  Illustration  of  Matrix  Factorization  based  CF 
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5 

1,2  and  3  are  users 
A,  B,  C,  D,  and  E  are  items 
R(1,D)  =  ? 

The  latent  dimension  k  =1 


Learning  U  and  V,  and  reconstructing  the  rating  matrix 


2.6308 
U  =  2.4109 
1.4706 


V  = 


1.6252 

1.2182 

1.5740 

1.5990 

2.5716 


4.2756  3.2047  4.1408 


fl  =  UVr  = 


4.2066  6.7654 


3.9182  2.9368  3.7946  3.8550  6.1999 
2.3901  1.7915  2.3147  2.3515  3.7819 


R(1,D)  is  predicted  as  4.2066 


*3 
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Challenges  of  Traditional  Recommender  Systems 


■  Data  sparsity  problem 

-  Social  media  data  is  big  data  but  the  available  data  for  most 
individuals  is  very  limited 

-The  user-item  rating  matrix  is  extremely  sparse  with  less  than  1% 
observed  ratings 

■  Cold-start  problem 

-  The  number  of  ratings  for  users  follows  a  power-law  distribution 

-  There  are  many  users  with  no  or  very  few  ratings 

-  Existing  recommender  systems  may  fail  to  make  recommendations  for 
co Id -start  users 
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Opportunities  from  Trust  Information 


■  Trust  provides  an  additional  source  for  recommendation 
improvement 

-  Overlap  between  one's  similar  users  and  trusted  users  is  low  (less 
than  10%) 

-  Mitigating  data  sparsity  problem 

■  Since  a  user  has  her  trust  network,  we  can  do 

recommendation  based  on  her  trusted  users 

-  Users'  preferences  are  similar  to  their  trust  networks 

-  Reducing  significantly  the  number  of  cold-start  users 
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Categorization  [Tang  et  ai.,  2013] 


■  Most  existing  trust-aware  recommender  systems  are  CF- 
based  methods 


Trust-aware  A  basic  CF 

CF  model  model 


Trust  model 


■  We  can  categorize  existing  trust-aware  systems  based  on 
their  basic  CF  models 

-  Memory-based  trust-aware  recommender  systems 

-  Model-based  trust-aware  recommender  systems 
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Memory-based  Trust-aware  Recommendation 


■  It  uses  memory-based  CF  methods,  especially  user-oriented 
methods,  as  basic  models 

■  It  usually  consists  of  two  steps 

-  Step  1:  obtaining  the  trusted  users  M  for  a  given  user  i, 

-  Step  2:  aggregating  ratings  from  the  trusted  users  obtained  by  the  first 
step  to  predict  ratings  for  user  i 

■  Step  2  is  the  same  as  that  in  traditional  memory-based 
methods,  and  different  methods  in  this  category  provide 
different  ways  to  obtain  trusted  users  in  Step  1 
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TidalTrust  vs  MoleTrust 


■  TidalTrust  only  considers  raters  at  the  shortest  distance 

-  Trusted  users  N,  is  the  set  of  users  at  the  shortest  distance 

-  Efficient 

-  High  precision 

-  Low  recall 

■  MoleTrust  considers  raters  up  to  a  maximum-depth  d 

-  Trusted  users  M  is  the  set  of  users  within  maximum-depth 
-Trade-off  between  precision  and  recall 


Ft;  + 


2-^tifcEjV i  ^ 1  ^ 
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An  Illustration  of  MoleTrust  for  Recommendation 


0  1.2  0.6  0  0  0 

0.5  0  0  0  0  0.5 

0.1  0  0  0.3  0.9  0 

0  0.7  0  0  0  0 

0  0  0  0.8  0  0 

0  1  0  0.2  0.5  0 


2  4??? 
4  5  5  ?? 
?  ?  4  2  ? 
?  ?  3  ?  4 
?  ?  ?  3  5 
?  ?  ?  ?  ? 


Setting  d  =  2  and  predicting  R(6,E)  =  ? 

-The  set  of  raters  in  the  paths  with  length  of  2  is  {5,  4,  2, 1} 
-  Only  {5,4}  rate  item  E 


R(6E)  rM/t(5,g)  +  rMfi(4,g)  0.5  *  5  +  0.2  *  4  1?n 

T„+Tm  0.5 +  0.2 

User  6  does  not  have  any  ratings  and  MoleTrust  can  do  recommendations  based  on  her 
trust  network 
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TrUStWalker  [Jamali  and  Ester,  2009] 


■  Instead  of  distant  neighbors  who  have  rated  the  target 

item,  it  uses  near  neighbors  who  have  rated  similar  items 
-Trusted  friends  on  similar  items 
-  Distant  users  on  the  exact  target  item 


■  It  combines  item-based  recommendation  and  trust-based 
recommendation  via  random  walk 

■  Each  random  walk  returns  a  rating  of  the  target  item  or  a 
similar  item 


431 
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TrustWalker 


■  Each  random  walk  starts  from  a  target  user  u  to  seek 
rating  score  for  item  i 


I 


■m-m 

■S  TJT 

‘  rr-._  'J  v  -j//f  -■-•fV  ‘  MM  '|  ‘>v- 

(£,■»«'  *<■ 


mfci 


t-s.-s-l  C  -jV  - 


*f\cv 


■  In  step  k  at  node  \/: 

-  If  u  has  rated  i,  return  R 


\  :fwt 


*7V 


ww  \  , f  %,»r  *  , J- 

-  With  the  probability  <f>v  ,  k ,  stop  random  walk,  select  a  similar  item  j 
rated  by  u  and  return  Rvj 

-  With  the  probability  1  -  ,  continue  the  random  walk  to  a  direct 

neighbor  of  v 
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An  illustration  of  TrustWalker 
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An  illustration  of  TrustWalker 


Rl=5 
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An  illustration  of  TrustWalker 


Rl=5 
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An  illustration  of  TrustWalker 


Continue? 


Rl=5 
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An  illustration  of  TrustWalker 


Rl=5 


R2=4 


lRizona  State  L»mi _ * 
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An  illustration  of  TrustWalker 


Rl=5 


R2=4 
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An  illustration  of  TrustWalker 


Continue? 


Rl=5 


R2=4 
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An  illustration  of  TrustWalker 


Continue? 


Rl=5 


R2=4 
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An  illustration  of  TrustWalker 


Continue? 


Rl=5 


R2=4 


R3=5 
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An  illustration  of  TrustWalker 


Rl=5 


R2=4 


R3=5 
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Model-based  Trust-aware  Recommendation 


■  Model-based  trust-aware  recommender  systems  choose 

model-based  CF  methods  as  their  basic  models 

-  Matrix  factorization  is  widely  chosen  as  the  basic  model 


■  There  are  three  common  ways  to  integrate  trust  information 

under  the  matrix  factorization  framework 

-  Co-factorization  methods 

-  Ensemble  methods 

-  Regularization  methods 
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Co-factorization  Methods 


A  user  shares  the  same  user  preference  factor  in  the 
rating  space  (rating  information)  and  the  social  space 


User 


preference  <- 
factor 


Trust 

Information:  T 


Other 

Factors 
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Representative  Systems 


SoRec  [Ma  et  al.,  2008] 


R,,  =  uy; 

y  =  uy] 


■  LOCABAL  [Tang  et  al.,  2013] 


Rtj  =  utvj 

Tij  -  UtHUTj 


Co-factorization  methods  can  jointly  predict  missing  ratings  and  trust 
relations. 
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Ensemble  Methods 


■  Users  and  their  social  networks  should  have  similar  ratings 
on  items 

■  A  missing  rating  for  a  given  user  is  predicted  as  a 
combination  of  ratings  from  the  user  and  her  trust  network 


A  missing 
rating  for  u 


u 

+  o 

u's  trust 
network 
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Representative  Systems 

■  STE  -  Ensemble  of  predicted  ratings  [Ma  et  al.,  2009a] 


R,  =  utv 


■  mTrust  -  Ensemble  of  predicted  ratings  and  observed 
ratings  from  her  trust  network  [Tang  et  al.,  2012] 

T \k 

Uk  (U;  ) 


Ru  =  uy 


CC 


uh^N (u, ) 


z 


RjM 

Arizona  State  „„  . . . 

UNIVERSITY  - - - 


- tU:  is  the  trust  strength  between  the  i-th  user  and  k-th  user 
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Regularization  Methods 


■  Regularization  methods  focus  on  a  user's  preference  and 
assume  that  a  user's  preference  should  be  similar  to  that  of 
her  social  network. 


■  Regularization  methods  add  a  regularization  term  to  force 
users'  preferences  to  be  close  to  those  of  trust  networks. 
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Representative  systems 


■  SocialMF  -  a  user's  preference  should  be  close  to  that  of  her 
social  network  [Jamali  and  Ester,  2010] 


min  ^11  Ui  — 


■  SoReg  -  two  connected  users  should  have  similar 
preferences  [Ma  et  al.,  2011] 


min 


E  2X 

i  ukeN(ui ) 
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Prediction  Accuracy  Evaluation 


Root  Mean  Squared  Error  (RMSE) 


RMSE  = 


<ut  ,v  >eO 


IOI 


Mean  Absolution  Error  (MAE) 


S' 


MAE  =  — ,>e° 


IOI 


-  Small  improvement  in  RMSE  or  MAE  terms  can  have  a  significant  impact  on  the 
quality  of  the  top-few  recommendation  [Koren,  2008] 
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Ranking  Accuracy  Evaluation 

■  Recall 

-How  many  of  acquired  items  were  recommended 
-Recall@N:  how  manytop-N  acquired  items  are  recommended 


■  Precision 

-How  many  recommended  items  are  acquired 

-Precision@N:  how  manytop-N  recommended  items  are  acquired 


Long  recommendation  lists  typically  improve  recall  while  reducing  precision 
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Coverage  Evaluation 


■  Item  coverage 

-The  proportion  of  items  that  the  recommendation  system  can 
recommend 

■  User  coverage 

-The  proportion  of  items  that  the  recommendation  system  can 
recommend 
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Incorporating  Distrust 


MU  viM 
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Introduction 


Summary 
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Distrust  in  Social  Sciences 


■  Distrust  can  be  as  important  as  trust 

■  Both  trust  and  distrust  help  a  decision  maker 
reduce  the  uncertainty  and  vulnerability  associated 
with  decision  consequences 

■  Distrust  may  exert  an  equally  important,  if  not 
more,  critical  role  as  trust  in  consumer  decisions 
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Understandings  of  Distrust  from  Social  Sciences 


■  Distrust  is  the  negation  of  trust  [j0sang  et  ai.,2003] 

-  Low  trust  is  equivalent  to  high  distrust 

-  The  absence  of  distrust  means  high  trust 

-  Lack  of  the  studying  of  distrust  matters  little 

■  Distrust  is  a  new  dimension  of  trust  [Lewicki  et  ai., 

1998] 

-Trust  and  distrust  are  two  separate  concepts 
-Trust  and  distrust  can  co-exist 

-  A  study  ignoring  distrust  would  yield  an  incomplete 
estimate  of  the  effect  of  trust 
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Distrust  in  Social  Media 


■  Distrust  is  rarely  studied  in  social  media 

-Social  media  data  is  based  on  passive  observations 

-  Lack  of  some  information  social  sciences  use  to  study 
distrust 

-  Lack  of  computational  understanding  of  distrust  with 
social  media  data 

■  Let  us  first  examine  the  properties  of  distrust 
before  going  to  the  computational  understanding  of 
distrust 
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Examining  Properties  of  Distrust 


■  Properties  of  trust  are  systematically  and  extensively 
studied 

-Transitivity,  asymmetry,  and  homophily 

■  Properties  of  distrust  are  rarely  studied  with  social  media 
data 


■  Can  we  simply  or  conversely  extend  the  properties  of  trust 
to  those  of  distrust  ? 

-  We  study  the  properties  of  distrust  in  parallel  to  those  of  trust 
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Transitivity  [Tang  and  Liu,  2014] 


■  Trust  is  transitive  (1st  table);  how  about  distrust? 

■  For  distrust  (2nd  table),  #u+w  is  comparable  to  #u-w 

■  Transitivity  may  not  be  applicable  to  distrust  +  q 


Trust 

J. 

Types 

Number 

Percentage  z7  ? 

^  it  +  V ,  V  +  W  J1  j  it.  +  w 

3,320,991 

97.75%  j*/ 

(u+v.v+w) ,  U-U) 

76.613 

7 

2.25%  " 

Distrust 

Types 

Number 

Percentage 

(u-v.v-w).  u+w 

38.729 

7 

59.73% 

/ 

(u-v.v-w),  u-w 

26.114 

7 

40.27%  /  ? 

O' 


u+v  and  u-v  represent  trust  and  distrust  relations  between  u  and  v,  respectively 
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Understanding  and  [Guha  et  ai„  2004] 


■  User  u  disagrees  with  the  statement  of  user  v 


-  <u-v,  v-w>  ->  <u+w> 

-  My  enemy's  enemy  is  my  friend 
-Structural  balance 


■  User  u  thinks  user  v 's  judgments  are  inferior  to  her  own 


-  <u-v,  v-w>  ->  <u-w> 

-  Status  theory 

■  So,  it  is  more  complicated  than  it 
appears  and  further  research  is 
needed 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  119 


Asymmetry  [Tang  and  Lm,  2014] 


■  Trust  is  asymmetric 

-  37.61%  of  relations  are  mutual-trust 

-  Hence,  u+v  is  not  equivalent  to  v+u,  or  v+u  ^u+v 


■  Distrust  is  even  more  skewed 

-  Only  5.86%  of  relations  are  mutual-distrust 

-  That  is,  we  are  more  confident  that  v-u  m  u-v 


v+u(%) 

v-u(%) 

v?u(%) 

u+v 

136,806(37.61) 

967(0.27) 

226,000(62.13) 

u-v 

967(2.09) 

2,623(5.86) 

42,606(92.23) 

/mi 


Arizona  State  University 
Data  Mining  and  Machine  Learning  Lab 


Trust  in  Social  Computing 


WWW2014  120 


Homophily  [Tang  and  Liu,  2014] 


■  Users  with  distrust  relations  are  more  likely  to  be  similar 
than  two  randomly  chosen  users 


Cl 

COSINE 

COSINE-CI 

Distrust  (s^) 

0.4994 

0.0105 

0.0142 

Trust  St 

0.6792 

0.0157 

0.0166 

Random  Pairs  (sr) 

0.1247 

0.0027 

0.0032 

PI 

9.57e-87 

1.19e-120 

4.88e-45 

P2 

1.71e-132 

5.83e-157 

3.72e-108 

P3 

7.84e-23 

1.99e-19 

9.32e-17 

Cl:  Commonly-rated  Items 
COSINE:  Rating-cosine  similarity 

COSINE-CI:  Rating-cosine  similarity  of  commonly  rated  items 

PI-  P-values:  HO:  Sd  <=  Sr;  Hi:  Sd  >  Sr 

P2-  P-values:  Ho:  St  <=  Sr;  Hi:  St  >  Sr 

P3-  P-values:  Ho:  St  <=  Sd;  Hi:  St  >  Sd 


■  Distrust  is  not  a  dissimilarity  measurement 


nu 
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Computational  Understanding  of  Distrust 


■  We  leverage  machine  learning  and  data  mining  techniques 
to  design  computational  tasks  to  help  us  understand  distrust 
with  passively  observed  social  media  data 


■  Task  1:  Is  distrust  the  negation  of  trust? 

-  If  distrust  is  the  negation  of  trust,  distrust  should  be  predictable  from 
only  trust 

■  Task  2:  Can  we  predict  trust  better  with  distrust? 

-  If  distrust  is  a  new  dimension  of  trust,  distrust  should  have  added 
value  on  trust  and  can  improve  trust  prediction 


■  The  first  step  to  understand  distrust  is  to  make  distrust 
computable  by  incorporating  distrust  in  trust  models 
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Distrust  in  Trust  Representations 


There  are  three  major  ways  to  incorporate  distrust  in  trust 
representation 

-  Considering  low  trust  as  distrust 

-  Extending  negative  values  in  trust  representations 

-  Adding  a  dimension  in  trust  representations 


Trust 


Trust 


Trust 


1 


0 


Distrust 


0 


0 


-1 


Distrust 


-1  Distrust 


43 
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A  Network  Illustration  of  Distrust  in  Trust  Representations 


■  Considering  low  trust  as  distrust 

-  Weighted  unsigned  network 


■  Extending  negative  values  in  trust  representations 

-  Weighted  signed  network  0  8 


l 


l 


■  Adding  a  dimension  in  trust  representations 

-  Two-dimensional  unsigned  network 
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Task  1:  Is  Distrust  the  Negation  of  Trust? 


■  If  distrust  is  the  negation  of  trust,  low  trust  is  equivalent 
to  distrust  and  distrust  should  be  predictable  from  trust 


IF 

Distrust 

— 

Low  Trust 

THEN 

Predicting 

Predicting 

Distrust 

Low  Trust 

■  Given  the  transitivity  of  trust,  we  resort  to  trust 
prediction  algorithms  to  compute  trust  scores  for  pairs  of 
users  in  the  same  trust  network 
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Algorithm  for  Task  1 


■  A  trust  predictor  is  chosen  to  calculate  trust  scores  for  pairs 
of  users  without  trust  relations 

■  Pairs  of  users  with  low  trust  scores  are  suggested  as  distrust 


<u,v>  with 
distrust 
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Experimental  Settings  for  Task  1 


■  Each  time  we  choose  x%  of 
pairs  of  users  with  trust  relations 

as  Ai 

1 

n. 


n2  pairs  of  users 
I 


\ 

N* 


ir 


■  Through  Task  1  with  a£,  we  predict  I Z)  I  pairs  of  users  with 
low  trust  P  from  N*  as  distrust 

-  D  is  the  set  of  pairs  with  distrust  as  ground  truth  in  the  data  set 


■  The  performance  is  computed  as 


PA  = 


\Dc\P\ 

\D\ 
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Evaluation  of  Task  1 


■  The  performance  of  using  low  trust  to  predict  distrust  is 
consistently  worse  than  randomly  guessing 

■  Task  1  fails  to  predict  distrust  with  only  trust  and  distrust  is 
not  the  negation  of  trust 


X  (%) 

dTP  (xl0-i>) 

dMF(xlO“b) 

dTP-MF(  x  10-b) 

Random(x  10  °) 

50 

4.8941 

4.8941 

4.8941 

5.6824 

55 

5.6236 

5.6236 

5.6236 

8.1182 

60 

7. 1885 

7.1885 

7.1885 

15.814 

65 

11.985 

11.985 

11.985 

19.717 

70 

13.532 

13.532 

13.532 

18.826 

80 

10.844 

10.844 

10.844 

16.266 

90 

12.720 

12.720 

12.720 

25.457 

100 

14.237 

14.237 

14.237 

29.904 

dTP:  It  uses  trust  propagation  to  calculate  trust  scores  for  pairs  of  users 

dMF:  It  uses  the  matrix  factorization  based  predictor  to  compute  trust  scores  for  pairs  of  users 

dTP-MF:  It  is  the  combination  of  dTP  and  dMF  using  OR 
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Task  2:  Can  we  predict  Trust  better  with  Distrust 


■  If  distrust  is  a  new  dimension  of  trust,  distrust  should 
provide  additional  information  about  users,  and  could  have 
added  value  beyond  trust 


■  We  seek  answer  to  whether  using  both  trust  and  distrust 
information  can  help  achieve  better  performance  than 
using  only  trust  information 


■  Task  2  is  to  incorporate  distrust  into  trust  measurements 
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Distrust  in  Trust  Metrics 


■  Most  trust  and  distrust  metrics  are  based  on  the  model  by 
extending  negative  values  to  trust  models  to  incorporate 
distrust 

■  The  introduction  of  distrust  in  trust  networks  converts 

unsigned  trust  networks  to  signed  trust  and  distrust  networks 
-  Social  theories  for  signed  network  such  as  balance  theory  and  status 
theory  can  be  used  to  understand  trust  and  distrust 
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Balance  Theory  [  Heider,  1946] 

■  Balance  theory  suggests  that  "the  friend  of  my  friend  is  my  friend" 
and  "the  enemy  of  my  enemy  is  my  friend" 

■  For  a  triad,  there  are  four  possible  sign  combinations  A(+,+,+), 

B(+,+,-)  C(+,-,-)  and  but  only  A(+,+,+)  and  C(+,-,-)  are 

balanc^H 


Balance  theory  is  developed  for 
undirected  networks  and  can  be 
applied  to  directed  networks  by 
ignoring  their  directions. 


A:  (+,+,+) 


B:  (+,+,-) 


Status  Theory  [Leskovec  et  al.,  2010a] 

■  Status  theory  is  developed  for  directed  networks 


■  A  positive  link  from  u  to  v  indicates  that  u  has  a  higher 
status  than  v 

■  A  negative  link  from  u  to  v  indicates  that  u  has  a  lower 
status  than  v 

■  For  a  triad,  status  theory  suggests  that  if  we  take  each 
negative  relation,  reverse  its  direction,  and  flip  its  sign  to 
positive,  then  the  resulting  triangle  (with  all  positive  edge 
signs)  should  be  acyclic 
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Status  theory 
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Trust  and  Distrust  Propagation  [Guha  et  ai.,  2004] 

■  A  single  step  of  distrust  propagation  in  trust  propagation 

Trust  propagation:  q  =  a±T  +  q-2TtT  +  a^T  +  Q4TTT 


K 


One  step  distrust  propagation: 


G  =  ^7fcCfe(T-D) 


k  =  1 


Multiple  steps  of  distrust  propagation  in  trust  propagation 


Trust  and  distrust  propagation: 


E  =  otiF  +  q2FtF  +  03  Ft  +  o4FFt 


K 


Propagation  aggregation: 


G  =  £7fcEfc 


k  =  l 
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Trust  and  Distrust  Matrix  Factorization  [Tang  and  uu,  2014] 


■  For  each  user  Ui,  we  introduce  one  dimensional  latent 
variable  n,  and  then  Fy  is  modeled  as  Fy  =  n  n  to  capture 
balance  theory 

-  Distrust  relations  are  represented  by  negative  values  in  F  =  T-D 

■  With  modeling  balance  theory,  trust  and  distrust  matrix 
factorization  disMF  models  Fyas 

F  =UVUT  +Ar.r. 

IJ  I  J  l  J 

T 

UyU j  models  correlation  between  user  preferences 
rirj  models  balance  theory 
A  controls  contributions  from  balance  theory 
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Experimental  Settings  for  Task  2 


■  Each  time  we  choose  x%  of 
pairs  of  users  with  trust 
relations  A*  as  old  trust 
relations  and  the  remaining 
as  new  trust  relations  A " 

■  Through  Task  2  with  A*  and 
P  from  NZ  as  trust 


Nj 

JL 


4  :  4 

0 

1  1  1 

1 

rn  ;  i 

1  \ 

l 

1 

x%  1 - X% 

D,  we  predict  ipairs  of  users 


-D  is  the  set  of  pairs  with  distrust  as  ground  truth  in  the  data  set 


■  The  performance  is  computed  as 

PA  \A}.r\P\ 

I  A"  I 
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Evaluation  of  Trust  and  Distrust  Propagation 


■  Incorporating  distrust  propagation  into  trust  propagation 
can  improve  the  performance  of  trust  measurement 

■  One  step  distrust  propagation  usually  outperforms  multiple 
step  distrust  propagation 
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Evaluation  of  Trust  and  Distrust  Matrix  Factorization 


■  Incorporating  distrust  with  balance  theory  can 
significantly  improve  the  performance  of  trust  prediction 


MF 


disMF 


Random 


50% 


0.1531 


0.1665 


0.0023 


3  3  70 


0.1502 


0.1(554 


0.0023 


60% 


0.1489 


0.1639 


0.0020 


65% 


0.1444 


0.1601 


0.0019 


70% 


0.1391 


0.1563 


0.0018 


80% 


0.1332 


0.1498 


0.0015 


90% 


0.1277 


0.1415 


0.0013 
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Findings  from  Task  1  and  Task  2 


■  Task  1  shows  that  distrust  is  not  the  negation  of 
trust 

-  Low  trust  is  not  equivalent  to  distrust 

-  Distrust  is  not  the  negation  of  trust 

■  Task  2  shows  that  the  performance  of  trust 

prediction  is  improved  by  incorporating  distrust 

-  Distrust  has  added  value  in  addition  to  trust 

-  Incorporating  distrust  can  improve  trust  computation 
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Distrust  in  Trust-aware  Recommender  Systems 


■  Genuine  distrust  information  tends  to  be  more  noticeable 
and  credible,  and  weighed  more  in  decision  making  than 
trust  information  of  a  similar  magnitude 


■  Users  might  or  might  not  accept  recommendations  from 
their  trusted  users,  but  will  certainly  exclude 
recommendations  from  their  distrusted  users 
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Distrust  in  Memory-based  Trust-aware  Systems  [victor 

et  al.,  2009] 


■  Distrust  as  a  filter 

-  Use  distrust  to  filter  out  "unwanted"  users  in  the  recommendation 
processes 


■  Distrust  as  a  dissimilarity  measure 

-  Consider  distrust  scores  as  negative  weights 
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Distrust  in  Model-based  Trust-aware  systems 

[Ma  et  al.,  2009] 


■  Users  with  distrust  relations  should  have  very 
different  user  preferences 

maxZ  ZAJI  II 

i  uk^D{ui^ 

-  Distrust  is  considered  a  dissimilarity  measure 

-  Forcing  users  preference  of  two  users  with  a 
distrust  relation  far  away  from  each  other 
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Mistrust,  Untrust,  and  Distrust  [Marsh  and  Dibben,  2005] 


■  Mistrust  is  misplaced  trust 

-  A  trustee  betrays  the  trust  of  the  trustor 

■  Untrust  is  a  measure  of  how  little  the  trustee  is  actually 
trusted 

-  The  trustor  has  little  confidence  in  the  trustee 


■  Distrust  is  a  measure  of  how  much  the  trustor  believes 
that  the  trustee  will  actively  work  against  them  in  a  given 
situation 
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Illustration  of  Mistrust,  Untrust,  and  Distrust  [Marsh  and 

Dibben,  2005] 


Distrust  Untrust  (Mistrust) 


Untrust  is  still  a 
positive  measurement 

While  distrust  is  a 
negative  measurement 
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Summary 
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■Properties  of  Trust 
■Classifications  of  Trust 
Representations 
■Probabilistic  vs  Gradual 
Trust  Representations 
■Single  vs  Multi-dimensional 
Trust  Representations 
■Trust  vs  Trust  and  Distrust 
Representations 


J 
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■Properties  of  Trust 
■Classifications  of  Trust 
Representations 
■Probabilistic  vs  Gradual 
Trust  Representations 
■Single  vs  Multi-dimensional 
Trust  Representations 
■Trust  vs  Trust  and  Distrust 
Representations 
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■Classifications  of  Trust 
Metrics 

■Global  and  Local  Trust 
Metrics 

■Supervised  and 
Unsupervised  Trust  Metrics 
■Binary  and  Continuous 
Trust  Metrics 
■Evaluation 
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Representing 

Trust 


Incorporating 

Distrust 


■Trust-aware  Recommender 
Systems 

■Opportunities  and 
Challenges 

■Model-based  Trust-aware 
Recommender  Systems 
■Memory-based  Trust-aware 
Recommender  Systems 
■Evaluation 


Trust 


Applying 

Trust 


J 
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Research  Directions  in  Measuring  Trust 


■  Solving  data  sparsity  problem  in  trust  measurements 

-  Power-law-like  distributions  suggest  that  most  of  users  only  have  few 
trust  relations 

-  Most  of  existing  algorithms  might  fail  for  users  with  few  trust  relations 

-  Integrating  multiple  sources  such  as  item  and  helpfulness  ratings  in 
Epinions  might  help 

-  Incorporating  social  theories  such  as  homophily  and  influence 

■  Measuring  trust  when  trust  is  not  explicitly  available 

-  There  are  no  explicit  trust  relations  in  some  social  media  websites 
such  as  Twitter 

-  Large  amounts  of  user  generated  content  and  user  interactions  are 
available 

-  Can  we  measure  implicit  trust  with  available  data? 
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Research  Directions  in  Trust-aware  Recommendation 


■  Capturing  multi-faceted  trust  and  trust  evolution 

-Trust  relations  under  different  contexts  may  differ 

-  Trust  relations  may  change  over  time 

■  Incorporating  cross-media  data 

-Trust  relations  on  one  site  are  often  sparse  and  incomplete 

-  Integrating  data  from  multiple  sites  may  provide  a  comprehensive 
and  complete  view  about  users 

■  Exploiting  weak  trust  relations 

-  Weak  tie  theory  suggests  that  it  is  more  often  that  novel 
information  flows  through  weak  rather  than  strong  ties 
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Research  Directions  in  Incorporating  Distrust 


■  Predicting  distrust  with  publicly  available  data 

-  Trust  is  a  desired  property  while  distrust  is  an  unwanted  one  for 
most  social  networking  sites  or  services 

-  Various  online  services  implement  trust  mechanisms 

-  Few  of  them  allow  online  users  to  specify  distrust  relations 

-  Distrust  relations  are  usually  not  available  publicly 

-  Interaction  data  is,  however,  pervasively  available,  which  might 
indicate  distrust  relations 


■  Exploiting  distrust  in  trust  applications 

-  Using  distrust  for  recommendation  is  still  an  open  problem 

-  Effects  of  distrust  in  information  propagation 

-  Distrust  in  content  filtering 

-  Distrust  in  e-commerce 
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